| Solver | Other Solvers | ||||||||||||||||||||||||
| CryptoMiniSat | lingeling | SAT-Power | PrecoSAT | MiniSat | Barcelogic | LySAT | rcl | borg-sat | CircleSAT | ManySAT 1.1 | SApperloT | antom | PicoSAT | glucose | SATHYS | ManySAT 1.5 | glucosER | riss | orpailleur | CirCUs | kw | SAT4J 2.2 | |||
| (64bit) | (64bit) | (32bit) | (32bit) | (64bit) | (32bit) | (64bit) | (64bit) | (32bit) | (32bit) | (64bit) | (32bit) | (32bit) | (32bit) | (32bit) | (64bit) | (64bit) | (32bit) | (32bit) | (32bit) | (32bit) | (64bit) | (64bit) | |||
| Mate Soos | Armin Biere | Abdorrahim Bahrami et al. | Armin Biere | Niklas Sšrensson | As’n Roberto et al. | Said Jabbour et al. | Jean-Marie Lagniez et al. | Bryan Silverthorn | Jingchao Chen | Said Jabbour et al. | Stephan Kottler et al. | Tobias Schubert et al. | Armin Biere | Gilles Audemard | Jean-Marie Lagniez et al. | Said Jabbour et al. | G. Karsirelos et al. | Norbert Manthey | Olivier Roussel | Hyojung Han et al. | Johan Alfredsson | Daniel Le Berre | |||
| Instance | SAT / UNSAT | France | Austria | Iran | Austria | Sweden | Spain | France | France | USA | China | France | Germany | Germany | Austria | France | France | France | France | Germany | France | USA | Sweden | France | |
| Hardware Verification (1 SAT, 23 UNSAT, 6 UNKNOWN) | |||||||||||||||||||||||||
| ibm/2004_rb10Sd.k85 | UNSAT | 4.2 | 12.5 | 21.8 | 8.1 | 4.2 | 4.6 | 6.7 | 5.8 | 5.2 | 11.4 | 5.0 | 9.4 | 5.1 | 1.8 | 4.6 | 6.2 | 5.1 | 4.5 | 5.5 | 4.8 | 8.2 | 9.1 | 6.3 | |
| ibm/SAT_dat.k100 | UNSAT | 3.8 | 5.0 | 11.1 | 5.8 | 2.6 | 3.3 | 5.3 | 2.9 | 3.4 | 8.0 | 3.9 | 6.1 | 2.7 | 4.8 | 2.6 | 3.5 | 3.7 | 2.6 | 5.8 | 2.5 | 9.1 | 5.9 | 15.6 | |
| ibm/SAT_dat.k45 | UNSAT | 1.5 | 0.1 | 2.3 | 0.2 | 0.5 | 0.7 | 0.8 | 0.7 | 1.1 | 1.1 | 0.8 | 1.1 | 0.8 | 0.2 | 0.7 | 0.7 | 0.8 | 0.6 | 0.6 | 0.7 | 0.9 | 1.2 | 1.5 | |
| ibm/SAT_dat.k50 | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| manolios/c10id_i | UNSAT | 78.0 | 36.0 | 101.7 | 82.8 | 126.4 | 38.6 | 44.8 | 47.4 | 47.0 | 122.2 | 49.0 | 107.9 | 40.7 | 230.3 | 33.1 | 59.3 | 125.5 | 44.1 | 139.7 | 46.4 | 190.0 | 84.6 | 147.6 | |
| manolios/c10idw_i | UNSAT | 88.8 | 38.5 | 93.2 | 83.9 | 53.5 | 41.2 | 48.1 | 48.2 | 51.8 | 113.4 | 48.9 | 104.1 | 43.8 | 186.8 | 33.8 | 83.7 | 100.5 | 36.9 | 147.1 | 52.9 | 236.3 | 65.1 | 120.0 | |
| manolios/c10ni_s | UNSAT | 26.9 | 10.1 | 14.6 | 6.2 | 2.8 | 2.9 | 5.4 | 3.3 | 4.4 | 6.6 | 3.5 | 6.1 | 2.9 | 1.2 | 3.3 | 4.9 | 3.9 | 3.0 | 5.1 | 3.4 | 4.1 | 7.7 | 10.3 | |
| manolios/c6n | UNSAT | 9.2 | 6.3 | 9.3 | 6.3 | 3.9 | 5.4 | 4.7 | 3.8 | 4.5 | 7.6 | 4.9 | 9.5 | 5.4 | 12.7 | 3.6 | 5.5 | 9.2 | 4.8 | 9.1 | 5.4 | 17.0 | 7.0 | 14.0 | |
| manolios/c7bidw | UNSAT | 101.1 | 57.1 | 158.3 | 110.8 | 65.0 | 53.6 | 52.0 | 64.1 | 59.8 | 119.2 | 62.0 | 106.5 | 60.7 | --- | 41.6 | 125.0 | 151.3 | 52.2 | 121.0 | 52.6 | 217.8 | 78.5 | 148.8 | |
| manolios/c7bidw_i | UNSAT | 86.8 | 51.1 | 145.9 | 97.5 | 65.2 | 48.5 | 50.9 | 62.7 | 55.9 | 108.5 | 50.5 | 94.8 | 56.8 | 880.2 | 40.5 | 117.0 | 89.1 | 44.5 | 107.8 | 55.9 | 237.9 | 70.8 | 162.1 | |
| manolios/c7n | UNSAT | 11.3 | 7.1 | 10.0 | 5.8 | 3.9 | 6.0 | 4.2 | 5.0 | 5.7 | 6.6 | 5.3 | 10.0 | 4.8 | 13.1 | 5.1 | 6.5 | 8.2 | 5.3 | 7.3 | 4.8 | 16.7 | 8.5 | 21.0 | |
| manolios/c8idw_s | UNSAT | 3.0 | 7.6 | 8.6 | 3.6 | 2.0 | 1.8 | 2.9 | 1.9 | 8.4 | 3.8 | 2.0 | 4.3 | 2.2 | 1.5 | 1.8 | 2.4 | 2.8 | 1.8 | 2.4 | 5.4 | 3.8 | 7.3 | 6.5 | |
| manolios/c8n_i | UNSAT | 19.4 | 9.2 | 11.4 | 7.0 | 6.4 | 8.9 | 6.7 | 7.1 | 6.4 | 10.6 | 7.4 | 10.5 | 7.3 | 21.5 | 5.2 | 9.3 | 10.2 | 6.7 | 12.7 | 5.9 | 23.2 | 11.3 | 23.7 | |
| manolios/c9b_i | UNSAT | 17.8 | 11.6 | 15.0 | 10.0 | 9.2 | 15.8 | 8.0 | 10.7 | 8.8 | 15.3 | 11.4 | 19.3 | 12.2 | 34.9 | 8.4 | 14.9 | 18.7 | 9.4 | 20.9 | 10.6 | 33.6 | 14.9 | 33.3 | |
| manolios/c9idw | UNSAT | 56.9 | 32.1 | 78.2 | 66.7 | 52.7 | 32.5 | 39.2 | 40.4 | 35.2 | 95.6 | 46.9 | 96.9 | 30.6 | 127.2 | 24.5 | 65.2 | 64.9 | 31.2 | 86.4 | 36.7 | 165.0 | 62.2 | 111.2 | |
| manolios/f6bid | UNSAT | 18.2 | 7.9 | 11.4 | 5.4 | 3.4 | 3.7 | 5.2 | 5.8 | 77.8 | 6.3 | 4.2 | 15.6 | 4.6 | 5.3 | 4.2 | 6.3 | 6.3 | 3.7 | 9.8 | 5.1 | 28.7 | 17.5 | 15.1 | |
| manolios/f7idw | UNSAT | 70.6 | 37.6 | 53.5 | 41.6 | --- | 56.8 | 60.0 | 228.2 | 286.9 | 64.9 | --- | 400.3 | 227.0 | 71.8 | 28.5 | --- | --- | 27.7 | --- | 48.9 | 806.7 | --- | 81.6 | |
| manolios/f7nidw | UNSAT | 112.8 | 53.1 | 67.3 | 48.1 | 615.7 | 44.9 | 49.7 | 237.4 | 284.0 | 76.7 | 64.7 | --- | 177.4 | 110.0 | 68.2 | 168.0 | --- | 32.7 | 799.6 | 43.0 | 555.0 | --- | 117.6 | |
| manolios/g7nidw | UNSAT | 12.4 | 6.3 | 9.0 | 5.4 | 3.7 | 3.6 | 7.3 | 4.4 | 5.6 | 7.6 | 12.9 | 13.9 | 6.6 | 6.8 | 3.6 | 6.8 | 66.8 | 3.7 | 7.0 | 6.0 | 68.1 | 12.4 | 9.8 | |
| manolios/g9bidw | UNSAT | 61.0 | 35.8 | 52.0 | 43.7 | 131.8 | 24.1 | 27.8 | 26.5 | 122.7 | 74.2 | 51.6 | 62.9 | 39.1 | 87.2 | 26.6 | 57.4 | 585.4 | 14.5 | 207.3 | 21.7 | 81.2 | 67.2 | 63.0 | |
| velev/11pipe_11_ooo | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/11pipe_k | UNSAT | --- | --- | 857.1 | --- | --- | 745.7 | 720.0 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/12pipe_bug8 | SAT | 410.4 | 22.0 | 194.5 | 76.7 | 107.8 | 101.2 | 15.3 | --- | 157.3 | 148.3 | 12.0 | 4.6 | 467.7 | 4.9 | 696.7 | 32.2 | 10.8 | 119.1 | 14.7 | --- | 241.4 | 364.7 | --- | |
| velev/12pipe_q0_k | UNSAT | 815.4 | 821.9 | --- | 737.7 | --- | --- | 728.1 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/16pipe_16_ooo | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/1dlx_c_iq46_a | UNSAT | --- | --- | --- | --- | 883.9 | 339.3 | --- | --- | --- | --- | --- | --- | --- | --- | 854.9 | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/1dlx_c_iq57_a | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/1dlx_c_iq60_a | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/2dlx_ca_bp_f_liveness | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| velev/9dlx_vliw_at_b_iq9 | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| Software Verification (3 SAT, 23 UNSAT, 4 UNKNOWN) | |||||||||||||||||||||||||
| babic/dspam_dump_vc972 | UNSAT | 10.4 | 4.7 | 14.5 | 5.6 | 1.5 | 3.4 | 4.0 | 10.0 | 8.4 | 193.4 | 9.1 | 21.8 | 4.1 | 0.5 | 22.7 | 8.3 | 4.3 | 10.5 | 1.6 | 8.2 | 1.4 | 6.1 | 7.0 | |
| babic/itox_vc1138 | SAT | 27.2 | 13.0 | 7.7 | 3.6 | 2.5 | 4.5 | 4.5 | 4.8 | 5.4 | 28.8 | 4.0 | 7.9 | 3.8 | 0.5 | 4.4 | 4.3 | 4.2 | 4.1 | 6.4 | 4.3 | 3.3 | --- | 10.2 | |
| bitverif/countbitsarray02_32 | UNSAT | 379.2 | --- | 302.4 | 269.7 | --- | 782.2 | --- | 331.6 | --- | --- | --- | --- | --- | --- | 527.3 | 315.1 | --- | 643.9 | --- | 866.8 | --- | --- | --- | |
| bitverif/countbitsarray32_32 | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| bitverif/countbitsrotate128 | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| bitverif/maxxor128 | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| bitverif/minxorminand128 | UNKNOWN | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| fuhs/AProVE07-08 | UNSAT | 746.7 | 609.6 | --- | 724.8 | --- | --- | 698.2 | 567.4 | --- | --- | 724.9 | --- | --- | --- | 593.4 | 617.9 | 582.6 | 651.9 | --- | 653.1 | 646.6 | 345.7 | --- | |
| fuhs/AProVE07-16 | UNSAT | 292.8 | 139.4 | 265.0 | 92.7 | 144.8 | 340.8 | 183.5 | 396.9 | 239.1 | 249.7 | 274.2 | 131.9 | 455.6 | 291.9 | 188.4 | 454.5 | 295.2 | 215.7 | 321.1 | 220.0 | 105.0 | 223.4 | --- | |
| fuhs/AProVE07-27 | UNSAT | 726.5 | 638.2 | 819.9 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | 664.0 | --- | --- | --- | --- | --- | --- | --- | |
| fuhs/AProVE09-20 | SAT | 51.2 | 12.8 | 51.7 | 53.5 | 38.7 | 30.6 | 38.7 | 15.4 | 34.6 | 32.5 | 35.3 | 32.1 | 25.1 | 19.3 | 51.4 | 84.6 | 40.2 | 61.0 | 23.5 | 36.3 | 265.8 | --- | 728.3 | |
| nec/hard-0-U-7061 | UNSAT | 12.6 | 11.0 | 19.7 | 10.0 | 3.2 | 7.8 | 8.7 | 6.7 | 7.1 | 16.6 | 7.5 | 8.6 | 7.3 | 5.8 | 6.7 | 7.6 | 7.7 | 6.9 | 5.8 | 7.1 | 6.6 | 8.7 | 9.4 | |
| nec/hard-10-U-15228 | UNSAT | 31.0 | 24.0 | 85.6 | 34.0 | 34.2 | 863.8 | 848.0 | --- | --- | 74.2 | 848.0 | 46.2 | 849.2 | 16.4 | --- | --- | 847.7 | --- | --- | --- | 52.9 | 24.2 | --- | |
| nec/hard-10-U-9007 | UNSAT | 212.2 | 23.6 | 73.1 | 38.8 | 31.5 | 87.8 | 104.6 | 95.2 | 96.0 | 105.6 | 102.7 | 80.6 | 103.2 | 7.5 | 95.5 | 99.5 | 103.7 | 94.8 | 198.8 | 104.9 | 18.6 | 32.9 | 100.3 | |
| nec/hard-11-U-7061 | UNSAT | 17.3 | 10.0 | 21.1 | 8.2 | 5.1 | 15.5 | 16.7 | 15.2 | 16.1 | 13.2 | 16.6 | 14.4 | 16.7 | 1.3 | 15.1 | 15.2 | 16.7 | 15.1 | 34.4 | 16.9 | 2.8 | 4.3 | 15.0 | |
| nec/hard-12-U-7061 | UNSAT | 24.1 | 17.7 | 44.9 | 28.7 | 9.5 | 23.1 | 22.9 | 21.0 | 21.3 | 53.8 | 22.2 | 19.0 | 21.1 | 18.0 | 19.0 | 22.1 | 23.3 | 20.0 | 48.0 | 22.3 | 17.9 | 19.9 | 34.4 | |
| nec/hard-13-U-9007 | UNSAT | 310.6 | 25.3 | 83.8 | 56.4 | 42.1 | 113.8 | 132.3 | 125.5 | 125.8 | 75.2 | 132.5 | 90.0 | 132.4 | 8.5 | 122.4 | 128.5 | 132.5 | 123.2 | 292.1 | 135.6 | 21.0 | 38.0 | 132.0 | |
| nec/hard-14-U-15228 | UNSAT | 34.1 | 22.7 | 91.6 | 30.4 | 36.8 | --- | --- | --- | --- | 75.9 | --- | 51.8 | --- | 9.0 | --- | --- | --- | --- | --- | --- | 57.5 | 25.0 | --- | |
| nec/hard-15-U-10652 | UNSAT | 31.3 | 36.7 | 122.2 | 56.7 | 21.4 | 11.6 | 57.7 | 19.9 | 216.8 | 490.6 | 9.9 | 21.5 | 11.2 | 22.6 | 11.6 | --- | 6.8 | 14.6 | 15.8 | 13.0 | 54.6 | 63.3 | 88.9 | |
| nec/hard-15-U-8013 | UNSAT | 31.1 | 29.4 | 78.0 | 38.7 | 361.5 | 798.8 | 802.0 | 874.3 | 893.9 | 75.6 | 795.4 | 67.6 | 800.8 | 10.1 | 877.0 | 886.9 | 799.8 | 875.5 | --- | 871.7 | 39.0 | 35.6 | 883.5 | |
| nec/hard-18-U-10652 | UNSAT | 30.6 | 47.4 | 149.0 | 77.5 | 27.9 | 11.8 | 48.3 | 20.6 | 266.8 | 798.2 | 9.5 | 25.8 | 6.5 | 31.9 | 14.2 | --- | 13.1 | 13.4 | 17.0 | 14.1 | 69.3 | 75.1 | 357.9 | |
| nec/hard-2-U-10652 | UNSAT | 30.4 | 11.1 | 17.9 | 18.1 | 4.5 | 53.8 | 52.9 | 51.8 | 53.3 | 26.5 | 52.7 | 14.5 | 52.6 | 1.0 | 51.5 | 51.8 | 52.8 | 51.5 | 13.7 | 55.2 | 9.8 | 13.4 | 53.0 | |
| nec/hard-2-U-9007 | UNSAT | 21.7 | 16.6 | 40.8 | 18.1 | 10.7 | 22.5 | 26.7 | 21.7 | 22.1 | 36.3 | 25.6 | 33.4 | 25.6 | 2.3 | 21.5 | 24.0 | 25.6 | 21.5 | 30.3 | 23.8 | 11.2 | 21.1 | 25.0 | |
| nec/hard-20-U-10652 | UNSAT | 46.5 | 46.5 | 177.3 | 86.9 | 33.8 | 22.7 | 69.7 | 33.6 | 306.6 | --- | 21.8 | 23.7 | 38.8 | 26.9 | 12.6 | --- | 15.8 | 13.2 | 35.1 | 22.0 | 86.7 | 90.4 | 204.7 | |
| nec/hard-25-U-7061 | UNSAT | 15.7 | 11.0 | 26.7 | 9.8 | 4.3 | 12.6 | 13.5 | 11.9 | 12.7 | 17.2 | 13.5 | 21.7 | 13.5 | 5.8 | 11.9 | 11.9 | 13.4 | 11.9 | 16.1 | 12.8 | 2.8 | 5.2 | 11.9 | |
| nec/hard-6-U-7061 | UNSAT | 17.5 | 16.3 | 29.3 | 18.4 | 5.9 | 15.7 | 16.5 | 11.9 | 12.1 | 26.4 | 14.1 | 14.1 | 13.5 | 11.4 | 12.0 | 14.1 | 14.6 | 11.9 | 15.6 | 13.2 | 11.8 | 14.9 | 19.9 | |
| nec/hard-7-U-10652 | UNSAT | 55.4 | 25.0 | 55.3 | 27.4 | 10.1 | 106.5 | 109.3 | 104.2 | 106.8 | 93.5 | 107.0 | 50.1 | 107.4 | 3.4 | 103.6 | 107.6 | 108.1 | 103.8 | 32.1 | 112.1 | 22.9 | 27.8 | 110.7 | |
| nec/hard-9-U-10652 | UNSAT | 61.2 | 33.4 | 71.9 | 29.8 | 12.6 | 131.4 | 133.1 | 128.7 | 131.6 | 101.1 | 132.3 | 12.2 | 132.5 | 13.1 | 127.5 | 131.5 | 131.9 | 127.7 | 36.9 | 137.5 | 28.9 | 34.1 | 134.0 | |
| post/zfcp | UNSAT | 5.2 | 8.7 | 158.3 | 14.1 | 4.2 | 0.9 | 3.4 | --- | 5.1 | 16.7 | 3.4 | 1.6 | 0.3 | 8.1 | 3.4 | --- | 3.4 | 5.6 | 0.0 | 3.3 | --- | 33.4 | 3.6 | |
| post/zfcp-2.8-u2-nh | SAT | 57.1 | 109.7 | --- | --- | 88.4 | 659.1 | 161.0 | 81.6 | 251.1 | --- | 66.9 | 62.7 | 98.0 | 44.4 | 50.8 | 110.0 | 64.9 | --- | 85.9 | 50.2 | 50.3 | --- | --- | |
| Cryptography (12 SAT, 3 UNSAT) | |||||||||||||||||||||||||
| desgen/gss-16-s100 | SAT | 182.2 | 45.5 | 67.0 | 57.8 | 27.2 | 199.4 | 50.6 | 131.0 | 148.2 | 547.7 | 98.6 | 106.2 | 35.6 | 106.2 | 106.9 | 12.3 | 98.4 | 6.8 | 52.1 | 27.7 | 58.8 | --- | --- | |
| desgen/gss-19-s100 | SAT | 258.7 | 241.4 | 605.9 | 23.6 | 22.9 | --- | 778.0 | 206.8 | --- | --- | 534.5 | --- | 543.6 | --- | --- | 199.3 | --- | --- | 247.1 | 90.8 | 584.9 | --- | --- | |
| desgen/gss-20-s100 | SAT | --- | 757.5 | --- | --- | --- | --- | 393.9 | 601.6 | --- | --- | --- | 332.5 | 82.7 | --- | 446.9 | --- | --- | 803.5 | --- | --- | --- | --- | --- | |
| desgen/gss-31-s100 | SAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| md5gen/gus-md5-07 | UNSAT | 69.8 | 267.2 | 108.7 | 127.9 | 53.6 | 463.3 | 110.5 | 56.0 | 44.1 | 675.7 | 67.9 | 75.5 | 34.1 | 82.7 | 78.9 | 67.8 | 85.6 | 62.2 | 137.5 | 96.1 | 126.2 | 65.1 | 447.3 | |
| md5gen/gus-md5-09 | UNSAT | 442.6 | --- | 635.2 | --- | 379.4 | --- | 784.5 | 482.1 | 729.3 | --- | 522.8 | 563.4 | 593.0 | 563.5 | --- | 697.9 | 732.1 | 806.3 | --- | --- | --- | 547.7 | --- | |
| md5gen/gus-md5-10 | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| mizh/md5_47_4 | SAT | 166.5 | 59.1 | 101.0 | 135.2 | 310.0 | 358.3 | 223.3 | 57.0 | 86.8 | 96.0 | 552.8 | 205.8 | 8.6 | 45.7 | --- | 53.8 | 17.6 | --- | 86.8 | --- | 885.0 | --- | 491.2 | |
| mizh/md5_48_1 | SAT | 41.9 | 155.6 | 737.3 | 605.6 | 162.7 | 883.9 | --- | 195.9 | 192.5 | 173.0 | 831.0 | --- | 38.1 | 510.3 | --- | 82.5 | --- | --- | --- | --- | --- | --- | --- | |
| mizh/md5_48_3 | SAT | 109.1 | 101.4 | 78.2 | 159.9 | 94.2 | 553.1 | --- | 89.6 | 336.6 | 205.3 | --- | --- | 55.8 | 12.5 | --- | 92.8 | 461.0 | --- | --- | --- | --- | --- | --- | |
| mizh/sha0_35_1 | SAT | 19.0 | 114.1 | 44.7 | 26.1 | 86.4 | 142.5 | 441.0 | 24.2 | 114.8 | 26.5 | 767.5 | 135.3 | 14.7 | 75.5 | 177.6 | 27.3 | 132.3 | --- | 68.4 | --- | --- | --- | 221.4 | |
| mizh/sha0_35_2 | SAT | 14.0 | 57.5 | 325.4 | 63.2 | 52.4 | 104.8 | 32.5 | 204.9 | 100.4 | 96.3 | 155.7 | 91.1 | 55.3 | 78.8 | --- | 18.1 | 118.9 | 476.6 | 64.5 | --- | 295.3 | --- | 59.2 | |
| mizh/sha0_35_3 | SAT | 87.6 | 79.0 | 17.8 | 46.0 | 40.1 | 222.3 | 39.4 | 47.2 | 82.2 | 30.9 | 749.3 | 190.8 | 46.4 | 29.6 | 539.1 | 107.0 | 182.2 | 502.2 | 286.1 | --- | 36.2 | --- | 142.6 | |
| mizh/sha0_35_4 | SAT | 33.2 | 66.1 | 176.1 | 61.0 | 113.2 | 236.1 | 187.7 | 21.0 | 150.9 | 19.9 | 394.4 | 51.2 | 37.1 | 167.2 | --- | 68.0 | 221.5 | --- | 54.4 | --- | 529.9 | --- | 192.0 | |
| mizh/sha0_36_5 | SAT | 43.0 | --- | --- | --- | 288.0 | 257.8 | --- | --- | 375.5 | --- | --- | 787.5 | --- | --- | --- | 397.4 | --- | --- | 254.4 | --- | --- | --- | --- | |
| Mixed (9 SAT, 16 UNSAT) | |||||||||||||||||||||||||
| anbulagan/dated-10-13-s | SAT | 19.4 | 8.9 | 29.2 | 12.8 | 31.5 | 10.8 | 12.8 | 24.8 | 17.6 | 32.3 | 34.9 | 10.4 | 18.9 | 25.7 | 7.4 | 10.1 | 18.1 | 30.2 | 11.4 | 119.6 | 13.4 | --- | 308.0 | |
| anbulagan/dated-10-13-u | UNSAT | 338.6 | 423.8 | 644.1 | 556.0 | --- | 642.2 | --- | --- | --- | 748.5 | --- | --- | --- | --- | 565.4 | --- | --- | 862.2 | --- | 657.8 | --- | 557.7 | --- | |
| anbulagan/dated-10-19-u | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| anbulagan/dated-5-11-u | UNSAT | 32.4 | 16.6 | 24.5 | 20.0 | 46.3 | 43.3 | 38.1 | 45.1 | 50.7 | 16.4 | 52.4 | 45.6 | 70.6 | 71.8 | 34.8 | 43.3 | 44.5 | 39.6 | 62.0 | 46.5 | 70.3 | 33.6 | 159.6 | |
| anbulagan/dated-5-13-u | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| anbulagan/dated-5-15-u | UNSAT | 123.6 | 111.4 | 185.2 | 119.9 | 200.8 | 259.1 | 283.2 | 313.5 | 255.4 | 317.7 | 500.2 | 582.0 | --- | --- | 220.0 | 464.9 | 319.8 | 231.2 | 294.5 | 352.4 | 230.7 | 83.6 | --- | |
| anbulagan/partial-5-17-u | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| anbulagan/total-10-19-s | SAT | 195.7 | 24.1 | 72.4 | 24.0 | 111.6 | 35.0 | 15.3 | 15.4 | 14.2 | 68.7 | 80.2 | 32.6 | 132.8 | 66.8 | 76.2 | 14.2 | 29.5 | 115.5 | --- | 14.2 | 27.7 | --- | --- | |
| bioinf/ndhf_xits_13_UNSAT | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| bioinf/q_query_2_L324_coli | UNSAT | 46.4 | 12.7 | 34.7 | 19.1 | 23.8 | 67.5 | 54.8 | 74.0 | 76.7 | 20.7 | 55.5 | 22.3 | 54.8 | 2.4 | 74.0 | 75.1 | 54.8 | 73.7 | 24.3 | 81.1 | 14.0 | 22.5 | 77.0 | |
| bioinf/q_query_3_l44_lambda | UNSAT | 218.0 | 197.4 | 243.8 | 207.0 | 119.6 | 194.7 | 191.6 | 230.6 | 206.1 | 295.9 | 205.3 | 231.1 | 859.5 | 267.8 | 114.7 | 349.3 | 190.5 | 145.7 | 281.4 | 262.9 | 204.6 | 106.5 | --- | |
| bioinf/q_query_3_l45_lambda | UNSAT | 188.0 | 161.3 | 283.9 | 220.5 | 104.0 | 219.0 | 169.7 | 204.2 | 212.3 | 290.8 | 189.2 | 237.8 | --- | 279.7 | 186.6 | 301.2 | 186.6 | 182.3 | 243.4 | 296.8 | 168.9 | 112.7 | --- | |
| bioinf/q_query_3_l48_lambda | UNSAT | 236.4 | 220.3 | 273.8 | 236.3 | 102.6 | 214.0 | 200.6 | 209.2 | 205.8 | 294.4 | 193.7 | 199.1 | 842.2 | 337.4 | 180.9 | 304.9 | 203.0 | 164.6 | 215.6 | 215.2 | 181.0 | 137.9 | --- | |
| bioinf/rpoc_xits_08_UNSAT | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| diagnosis/ACG-15-10p0 | UNSAT | --- | 260.5 | 731.1 | 612.1 | --- | --- | --- | --- | 719.9 | 694.7 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| diagnosis/ACG-20-10p1 | SAT | --- | 644.3 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| diagnosis/UCG-20-10p1 | SAT | --- | 615.9 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| diagnosis/UTI-20-10p0 | UNSAT | 881.8 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| grieu/vmpc_27 | SAT | 213.9 | 13.9 | 58.4 | 87.9 | 39.8 | 205.6 | 5.9 | 70.7 | 13.9 | 76.6 | 103.1 | 43.7 | 55.4 | 23.2 | 0.7 | 27.5 | 79.9 | 30.6 | 13.0 | 76.9 | 64.1 | 7.9 | --- | |
| grieu/vmpc_28 | SAT | 67.3 | 208.5 | 45.1 | 4.7 | 232.4 | --- | --- | 27.7 | 76.1 | 289.1 | 213.5 | 72.4 | 32.7 | 1.8 | 177.9 | 292.9 | 166.2 | 228.3 | --- | 67.0 | 480.5 | 67.6 | 637.2 | |
| grieu/vmpc_31 | SAT | 807.7 | --- | 101.1 | --- | --- | --- | --- | --- | --- | 366.3 | 220.3 | --- | --- | --- | 193.1 | --- | --- | 200.1 | --- | --- | --- | --- | --- | |
| jarvisalo/eq.atree.braun.12.unsat | UNSAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| palacios/safe-30-h30-sat | SAT | 28.3 | 9.8 | 26.9 | 6.4 | 3.1 | 10.5 | 10.1 | 10.0 | 11.0 | 11.8 | 10.3 | 14.1 | 10.1 | 31.9 | 10.3 | 11.1 | 10.1 | 11.0 | 4.0 | 16.4 | 123.9 | --- | 87.6 | |
| palacios/sortnet-8-ipc5-h19-sat | SAT | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | |
| palacios/uts-l06-ipc5-h32 | UNSAT | 78.6 | 43.0 | 93.9 | 56.0 | 66.2 | 197.0 | 24.5 | 34.8 | 25.7 | 67.2 | 30.2 | 166.2 | 31.1 | 227.4 | 19.4 | 34.8 | 27.7 | 18.3 | 86.4 | 19.1 | 145.4 | 147.3 | 328.4 | |
| #Solved: | 74 | 73 | 71 | 69 | 67 | 67 | 66 | 65 | 65 | 65 | 65 | 64 | 64 | 63 | 63 | 63 | 62 | 62 | 58 | 58 | 62 | 51 | 50 | ||
| #Solved SAT/UNSAT: | 20/54 | 21/52 | 18/53 | 17/52 | 19/48 | 17/50 | 16/50 | 18/47 | 18/47 | 17/48 | 18/47 | 17/47 | 19/45 | 17/46 | 14/49 | 19/44 | 16/46 | 13/49 | 15/43 | 10/48 | 15/47 | 3/48 | 10/40 | ||
| Total time for solved instances (in sec.): | 10.232.1 | 8.128.9 | 10.479.1 | 6.693.6 | 5.791.0 | 11.223.9 | 9.497.1 | 7.133.5 | 8.310.8 | 9.070.7 | 10.439.1 | 6.132.8 | 7.770.2 | 5.369.3 | 8.045.6 | 8.287.5 | 7.951.3 | 8.537.3 | 5.426.7 | 6.257.4 | 8.771.6 | 3.927.7 | 7.190.1 | ||
| Average time per solved instance (in sec.): | 138.3 | 111.4 | 147.6 | 97.0 | 86.4 | 167.5 | 143.9 | 109.7 | 127.9 | 139.5 | 160.6 | 95.8 | 121.4 | 85.2 | 127.7 | 131.5 | 128.2 | 137.7 | 93.6 | 107.9 | 141.5 | 77.0 | 143.8 | ||
| Rank: | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | erroneous results during finals | erroneous results during finals | not qualified | ||